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Limiting distributions 

for explosive PAR(l) time series 

with strongly mixing innovation 

Dominique Dehay 0 


Abstract : This work deals with the limiting distribution of the least squares 
estimators of the coefficients a r of an explosive periodic autoregressive of order 1 
(PAR(l)) time series X r = a r X r _i+u r when the innovation {uk} is strongly mixing. 
More precisely {a r } is a periodic sequence of real numbers with period P > 0 and 
such that IIr=l l a r| > 1- The time series {u r } is periodically distributed with the 
same period P and satisfies the strong mixing property, so the random variables u r 
can be correlated. 
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1 Introduction 

Many man-made signals and data, even natural ones, exhibit periodicities. The non¬ 
stationary and seasonal behavior is quite common for many random phenomena as 
rotating machinery in mechanics (see Antoni 2009), seasonal data in econometrics 
and climatology, but also signals in communication theory, biology to name a few 
(see e.g. Bloomfield et al. 1994; Chaari et al. 2014; Collet and Martinez 2008; 
Dragan et al. 1982; Franses and Paap 2004; Gardner et al. 2006; Serpedin et al. 
2005; and references therein). Periodic autoregressive (PAR) models are one of the 
simplest linear models with a periodic structure. After more than fifty years of study 
these models and their generalizations (periodic ARMA (PARMA), etc.) remain a 
subject of investigations of great interest as they can be applied in modeling periodic 
phenomena for which seasonal ARIMA models do not fit adequatly (see e.g. Adams 
and Goodwin 1995; Bittanti and Colaneri 2009; Francq et al. 2011; Osborn et al. 
1988). 
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It is well known that such linear models can be represented as vectorial autore¬ 
gressive (VAR) models. However the general results known for VAR models do not 
take into account the whole periodic structure of the PARMA models (Basawa and 
Lund 2001; Tia and Grupe 1980) in particular the fact that the innovation can be 
periodically distributed. Thus specific methods have been developped for PAR and 
PARMA models. 

There is a large amount of publications on the estimation problem for the coef¬ 
ficients of PARMA models essentially whenever the model is stable, that is periodic 
stationary also called cyclostationary (see e.g. Adams and Goodwin 1995; Aknouche 
and Bibi 2009; Basawa and Lund 2001; Francq et al. 2011; Pagano 1978; Tiao and 
Grupe 1980; Troutman 1979; Vecchia 1985). The unstable case has been also studied 
when some autoregressive coefficients are in the boundary of the periodic stationary 
domain (see e.g. Aknouche 2012a, 2012b; Aknouche and Al-Eid 2012; Boswijk and 
Franses 1995, 1996; Ghyshels and Osborn 2001 and references therein). 

There are few results concerning explosive PAR model. Aknouche (2013) studies 
the case of explosive PAR models driven by a periodically distributed independent 
innovation. However the independence of the innovation is too stringent in practice 
(see e.g. Aknouche and Bibi 2009; Francq et al. 2011 and references therein). 

In this work we relax the independence condition, and for simplicity of presen¬ 
tation, we consider periodic autoregressive of order 1 time series that is PAR(l) 
models. To state the convergence in distribution of the estimators (Theorems |Tj 
and [2]) we impose that the periodically distributed innovation is strongly mixing (see 
e.g. Bradley 2005). Thus it can be correlated and it satisfies some asymptotic inde¬ 
pendence between its past and its future (see condition (M) in Section [3J. However 
there is no condition on the rate of the asymptotic independence. This is similar to 
what Phillips (1987) showed for the autoregressive time series with a unit root and 
constant coefficients. 

Here we study the least squares estimators (LSE) of the PAR(l) coefficients, and 
the limiting distributions stated in Theorem |Tj below generalize the results obtained 
by Monsour and Mikulski (1998) for explosive AR models with independent Gaus¬ 
sian innovation (see also Anderson 1959; Stigurn 1974) and by Aknouche (2013) for 
explosive PAR models with independent innovation. The rate of convergence of the 
estimators depends on the product of the periodic PAR(l) coefficients of the PAR(l) 
model (Theorem [T]) . Actually this product determines whether the model is stable, 
unstable or explosive. Thus it is subject of great interest and we takle the problem 
of its estimation. For this purpose we consider two estimators : the product of the 
LSE of the PAR(l) coefficients (see (Aknouche 2013) for independent innovation), 
and a least squares estimator (Theorem [2j). By simulation we detect no specific dis¬ 
tinction between these estimators for the explosive PAR(l) models. The theoretical 
comparison of the limiting distributions of the two estimators is out of the scope of 
the paper and will be subject to another work. 

The paper is organized as follows. In Section [2] the model under study is defined 
as well as the notations. Then the asymptotic behaviour as n —>• oo of the scaled 
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vector-valued time series ( (j)~ n X n p+ r : r = 1,..., P) is stated in Section [3] where cj) 
is the product of the periodic coefficients a r of the explosive PAR(l) model, thus 
\(j)\ > 1. The period is P > 0. Section [I] deals with the consistency of the least 
squares estimators a r of the PAR coefficients a r , r = 1,..., P, as well as the limiting 
distributions of the scaled errors 4> n (a r — a r ), as n —» oo. Next in Section [5] we 
consider the problem of estimation of the product </>. The asymptotic behaviour of 
the estimators introduced in this paper are illustrated by simulation in Section [6l 
For an easier reading and understanding of the statements of the paper, the proofs 
of the results are presented in Appendix. 

2 Background : PAR(l) time series 

Consider the following PAR(l) model 

Afc O’k^k-l T fJ'kt k 1 j 2, . . . , (1) 

where {a*,} is a periodic sequence of real numbers and {uk} is a real-valued periodi¬ 
cally distributed sequence of centered random variables defined on some underlying 
probability space (fi, P, P). We assume that the periods of {a*,} and of {uk} have 
the same value P > 0. Thus ap +r = a r and £[up+ s , ..., up +r \ = C[u s ,... ,u r \ for 
all integers s and r. To be short, in the sequel the sequence {£&} is called innovation 
of the model although it is not necessarily uncorrelated. Denote 

r 

A* -1 := 1, A r s := aj for 1 < s < r, and A r s := 0 otherwise 

j=s 

and let <ft := A± = n,-=i a r - Since {ak} is periodic with period P > 0, we have 
A™ p+r = A\(f) n and we obtain the decomposition 

X nP+r = A\X nP + UP = A[r {■X 0 + Z n _ r) + [#> (2) 

where 

r 

UP :=^A; +1 n nP+s , 

S=1 

Z_i := 0 and for n > 1 

Tl P Tl 

z n : = J2 r'" 1 E a s+i u ip+s = E r l ~ l u[ p) . 

1=0 8=1 1=0 

Note that the sequence { (uP ,..., uP) n G is strictly stationary (stationarily 
distributed). 

If |0| < 1, the model is stable and X n p +r converges in distribution to some ran¬ 
dom variable Q r > as n 4 oo, If \(j)\ = 1, the model is unstable : its behaviour is 
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similar to a random walk; indeed for each r, the time series {X n p +r } is a random 
walk when the innovation {uk : k > nP + r} is independent with respect to the 
random variable X n p +r . 


Henceforth we assume that the time series {X*.} satisfies the PAR(l) equation dTJ) 
with \(f>\ > 1. We also assume that the initial random variable Xo is square integrable. 
Moreover the innovation { u is centered periodically distributed with second order 
moments. Thus {u^} is periodically correlated (see Hurd et al. 2002) and we have 
E[[4, r) ] = 0 as well as 


cov 


rr(n) ttP 2 ) 
^ n\ 5 ^ n 2 


ri r2 

S ^?i + 1^2+l COV Kl > U (n 2 -n a )P+ aa ] 
* 1=1 *2 = 1 


for all integers n, ni < n, 2 , and r, = 1 Denote a r := ^/var[u r ] and 


:= cov 


C/ (r) C/ (r) 

> U 2+n 


3 Explosive asymptotic behaviour of the model 


In the forthcoming proposition we study the asymptotic behaviour of the time series 
{Xk}- Recall that we assume that \(j>\ > 1. 

Proposition 1 For any r = 1, ..., P 


lim (j> n X n p +r = A\ (Xo + C) a.s. and in q.m. 

n—>-oo 

where 

n 

£ := lim Z n = lim cjP l ~ l Ua.s. and in q.m. 

n —>00 n—>00 1 

1=0 

Moreover 

U^-A{C:r = l,...,P 


lim £ [X nP+r - <j, n A{ (X 0 + C) 

n—too 


= 1,...,P]=C 


Remarks 

1) Assume that Pr[Xo + ( / 0] / 0, then conditionally that Xq + £ / 0, the 
sequence {|Xfc|} converges to infinity almost surely as k —>• 00 . Thus conditionally 
that Xo + C / 0, the paths of the time series { X are explosive. 

2) When Xo = —£ almost surely, the time series { Xk} which follows the PAR(l) 
model with \(f>\ > 1, is periodically distributed and satisfies the following stable 
PAR(l) equation 

Xk = a k 1 Xk -1 + u k 

where {u^} is some periodically distributed time series. More precisely 


u* nP+r = A\ 1 (a r — a r x ) ^2 4> 1 lu n+i + u n 1] +u nP+r . 

1=0 
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The estimation problem of the coefficients of such a PAR equation is now well-known, 
see e.g. (Acknouche and Bibi 2009; Basawa and Lund 2001; Francq et al. 2011 and 
references therein). 

3) To state the convergence in quadratic mean in Proposition |T] we can easily re¬ 
place the assumption that the innovation { Uk } is periodically distributed by the less 
stringent one that the innovation is periodically correlated. 


4) When the innovation {uk} is uncorrelated and periodically distributed we obtain 
that 


E 


{Zn - CY 


-In tAP) 


cA zn K { 


0 


-1 


and 


var [£] = Kq 


( P) 


|2 -1’ 


with 4 P) = Y2Y=MY+i) 2(7 s 


4 Least squares estimation of the coefficients 


Now we deal with the estimation problem of the coefficients a r , r = 1 ,,P, from 
the observation Xf., k = 0,... ,nP , as n —>• oo. For that purpose we determine the 
periodic sequence {bk} that minimizes the sum of the squared errors 

nP P n —1 

E ^ - h k x k-if = E E ( X i p +r - WXjP+r- r) 2 . 

k= 1 r= 1 j =0 

Since X”.jp+ r = a r Xjp +r _ i + Ujp +r , for j = 0,..., n — 1, and r = 1,... , P, the least 
squares estimator (LSE) of a r is defined by 


flr •- 


n—1 

^ ^ Xj p-j-r—1 Xj P-\-r 
3= 0 


n—1 


— a r + 


n—1 

^ ^ XjP+r—l UjP+r 
3=0 


n—1 


— a r + 


ri(r) 


YiXjP+r-lY 

3=0 


Y( x J p + 

3=0 


T ' B <r)' 

77 


r— 1 ) 


where from expression ([2]) we can write 


n—1 n—1 

B < r) ■■= E { X 3P+r- 1) 2 = E K'V( x o + Zj. 1) + (3) 

3=0 3=0 


and 


n—1 n—1 n—1 

ClY '■= E X jP+r~l u jP+r = A r A l E Y’iXo + Zj-i)UjP+r + E (4) 

3=0 3=0 j =0 


Here t/j 0) := 0. 
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Note that under Gaussian and independence assumptions on the periodically 
distributed innovation {uk}, the LSE a r coincides with the maximum likelihood 
estimator of a r . 


To prove the convergence in distribution of the scaled errors in the following 
results we use the next strong mixing condition. The notion of strong mixing, also 
called a-mixing, was introduced by Rosenblatt (1956) and it is largely used for mod¬ 
eling the asymptotic independence in time series. The condition could be weakened 
using the notion of weak dependence, but this is out of the scope of the paper. For 
more information about mixing time series and weak dependence see e.g. (Bradley 
2005; Dedeker et al. 2007; Doukhan 1994 and references therein). 

(M) lim a(n) = 0 where a(n ) = sup iPfAnB] — P[T]P[B]|, the supremum 

n—> oo 1 1 

being taken over all k E N and all sets A E F k , and B E Fk+n- Here the a-fields J~ k 
and iFk+ n are defined by T k := F(Xo,Uj : j < k ) and Fk+n '■= F(uj : j > k + n). 

Furthermore, in the following we assume that the underlying probability space 
(Q, F, P) is sufficiently large so that there is a sequence of real valued random vari¬ 
ables which is independent with respect to Xq and the innovation {uk}, and 
such that C [«q, ..., u*p_,] = C [ u n p ,..., iq] for any integer n > 1. This is always 
possible at least by enlarging the probability space. 


Now we state the strong consistency of the LSE a r of a r , as well as the asymptotic 
limiting distribution of the scaled error <f n (a r —a r ) for the explosive PAR(l) model (jT]). 


Theorem 1 Conditionally that Xq + ( 0, the least squares estimator a r converges 

to a r almost surely as n —>• oo, for r = 1,..., P. Furthermore assume that P[Xo+C = 
0] = 0 and the mixing condition (M) is fulfilled, then the random vector of the scaled 
errors {(f n (a r — a r ) : r = 1,..., P} converges in distribution to 


- 1)C 


A[ 1 (Xq + C) 


:r = 1,...,P 


as n -> oo. The random variable ( is defined in Proposition [7J the random vector 
(Cl, ■ • •, C p) i s independent with respect to (Xq,C), and its distribution is defined by 


C[C r -.r = l...,P}=C 


J u* jP _ r : r = 1,... ,P 

3 =1 


where the sequence {u£} is independent with respect to Xq and {uk}, and such that 
C [uq, ..., u* nP _^\ = C [u n p ,..., tti] for any integer n > 1. 


Note that in general the limiting distribution of (f> n (a r — a r ) is not parameter free, 
that is, it depends on the parameters we are estimating. Under Gaussian assumption 
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on the periodically distributed innovation {uk}, the random variables £ and £* are 
Gaussian and independent, so the distribution of ratio C*/C is a Cauchy distribution 
(see also Aknouche 2013). In fact, the limiting distributions in Theorem [T] have 
heavy tails. 


5 Estimation of <f> 


To estimate <f>, the product of the coefficients a r , r = 1,..., P, we can consider the 
product of the estimators a r : 

p 

(j) — 11 CL r . 
r —1 

Then from Theorem [I] the estimator (j) converges almost surely to <f> conditionally 
that Xq + ( 0. Thanks to the Delta-method (Theorem 3.1, Van der Vaart 1998) 

we readily deduce the asymptotic law of the normalized error </> n (^> — m. 


lim C[(j) n [(j) — 0)] = C 


- 1 


^o + C 


r =1 


P /-* 
r+l^r 


when we assume that P[Aq + C = 0] = 0 and the mixing condition (M) is fulfilled. 
See (Aknouche 2013) for independent innovation. 

Besides, we can define a least squares estimator of (f). For that purpose, note that 
from relation JT]) and the periodicity of the coefficients, we obtain for all j € N* and 

(r) 

r = 1,..., P, that Xjp +r = (f)X(j_^ P+r + V- ; where 


p -1 

VP = Y. Ar r-k+lUjP+r-k- 
k=0 


Since the innovation {uk} is periodically distributed with the same period P, the 
sequence {..., Vj P> ) ■ j € Z} is strictly stationary (stationarily distributed). 
Then minimizing the sum of the squared errors 


nP n —1 P 

( Xk - bXk -pf = E E ( X i p +r ~ bX U-l)P+r) 


k=P +1 


3 =1 r=1 


2 


we define the least squares estimator 0 as 

nP 

y XkXk-p 

y k=p +i 

—- 

y (-Afc-p ) 2 

k=P +1 


Cn 

' + K 
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where 


n —1 P nP Ti—l P 

= E E %-l)P+rE r) and B n = £ (X fc _p) 2 = £ E (*(i-i)P + ,) 2 - 

j=l r=l fc=P+l j=l r=l 

Then following the same arguments as for the LSE a r , we can state the forthcoming 
result. 

Theorem 2 Conditionally that Xq + ( 0, the least squares estimator cj) converges 

to 4> almost surely. Assume that P[A"o + C = 0] = 0 and the mixing condition (M) is 
fulfilled, then the scaled error 4> n ((j) — (fi) converges in distribution 


lim C [fi n (fi) — ] = C 


(</> 2 ~ 1 ) C * 


LEE K + i)~ 2 (x 0 + oJ 


(5) 


conditionally that Xo + £ / 0, as n —»• oo. Here C* is a random variable independent 
with respect to Xq and £. The distribution of C* coincides with the distribution of 


p p-i 


OO 


E E ^r+l^r-k+l E ^ J U *jP-r+k■ 

r =1 k =0 j =1 


In the next section we see by simulation that the distributions of (f> and of cj) seem to 
be similar when \<f\ > 1. The theoretical comparison of these distributions is out of 
the scope of the paper. 


6 Simulation 

Here we present the simulations of some explosive PAR(l) time series, and we illus¬ 
trate the behaviour of the LSE a r , (f and of (f for different values of the coefficients 
a r , r = 1 ,,P and for different types of innovation. For that purpose we consider 
the PAR(l) model dU) with period P = 6. The periodic coefficients a r s are given in 
Table |H 


Table 1: PAR(l) coefficients 



<U 

a 2 

<13 

a4 

as 

a 6 

0 

family 1 

0.8 

1.2 

1 

1.5 

1.1 

0.9 

1.4256 

family 2 

0.8 

1.1 

1 

1.5 

1.1 

0.7 

1.0164 

family 3 

0.5 

1 

1 

2.5 

1.6 

0.5 

1 

family 4 

0.5 

1 

1.5 

1.62 

1.6 

0.5 

0.972 


Thus we simulate the cases \ fi\ > 1, \fi\ close to 1, <p = 1 and \ fi\ < 1. The innovation 
is defined by 


{irk 

u k = cos j v k 


where 


Vk = 


m 


y/rn +T 

l ={) 
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the random variables e^, k £ N, are independent and identically distributed, and 
m £ {0, 2000}. When m = 0, we have Vk = e&, k € N, and the random variables Uk 
are periodically distributed and independent. When m = 2000, the random variables 
Uk are periodically distributed and correlated. Actually they are m-dependent, thus 
strongly mixing. We consider two distributions for the e^s : the standard normal 
distribution Af( 0,1), and the uniform distribution £/[—1000,1000]. Hence in the last 
case the distribution of the e&s is spread out. 

To sum up, for each family of coefficients, we obtain four PAR(l) time series 
that we simulate with different lengths T = nP = 6n. In each case we perform 100 
replications. The algorithm of the simulation is implemented in ’R’ software code. 
Below we present some of the tables and histograms that we obtain to compare the 
results. 


Table 2: \<j>\ = 1.4256 and uncorrelated Gaussian innovation : C\tk[ = Af( 0 , 1), m = 0, n = 20 


parameter 

0.8 

1.2 

1 

1.5 

1.1 

0.9 

1.4256 


estimate 

Ol 

02 

03 

04, 

05 

06 

0 

0 

mean 

0.8001 

1.1999 

0.9999 

1.4999 

1.0999 

0.9000 

1.4257 

1.4256 

median 

0.8000 

1.1999 

1.0000 

1.4999 

1.0999 

0.9000 

1.4256 

1.4255 

error 

mean 

2e-04 

-4e-05 

-2e-06 

-8e-05 

-le-05 

7e-06 

2e-04 

9e-05 

sigma 

2e-03 

4e-04 

8e-06 

8e-04 

9e-05 

9e-05 

3e-03 

2e-03 

boxplot 
u. whisker 

8e-04 

2e-04 

8e-07 

4e-04 

6e-05 

6e-05 

9e-04 

8e-04 

u. hinge 

3e-04 

5e-05 

3e-07 

9e-05 

2e-05 

2e-05 

3e-04 

3e-14 

1. hinge 

-2e-04 

-7e-05 

-4e-07 

-2e-04 

-2e-05 

-2e-05 

-2e-04 

-2e-04 

1. whisker 

8e-04 

-2e-04 

-9e-07 

-5e-04 

-6e-05 

-5e-05 

-7e-04 

-8e-04 

percentile 
abs 0.95 

4e-03 

le-03 

7e-06 

2e-03 

3e-04 

3e-04 

4e-03 

4e-03 


Table 3: \(j)\ = 1.0164 and uncorrelated Gaussian innovation : C[tk\ = A/"(0,1), m = 0, n = 200 


parameter 

0.8 

1.1 

1 

1.5 

1.1 

0.7 

1.0164 


estimate 

Ol 

02 

03 

04 

05 

06 


<t> 

mean 

0.7965 

1.0996 

0.9999 

1.4986 

1.0999 

0.7000 

1.0131 

1.0107 

median 

0.7994 

1.0999 

1.0000 

1.4999 

1.1000 

0.6999 

1.0158 

1.0154 

error 

mean 

-4e-03 

-4e-04 

-3e-05 

-2e-03 

-4e-05 

4e-05 

-4e-03 

-6e-03 

sigma 

le-02 

2e-03 

2e-04 

7e-03 

5e-04 

le-03 

9e-03 

3e-02 

boxplot 
u. whisker 

4e-03 

4e-04 

2e-05 

2e-03 

3e-04 

9e-04 

4e-03 

3e-03 

u. hinge 

2e-04 

5e-05 

5e-06 

4e-04 

8e-05 

3e-04 

2e-04 

-5e-05 

1. hinge 

-3e-03 

-3e-04 

-4e-06 

-le-03 

-9e-05 

-3e-04 

-3e-03 

-2e-03 

1. whisker 

-5e-03 

-6e-04 

-2e-05 

-3e-03 

-4e-04 

-8e-04 

-5e-04 

-7e-03 

percentile 
abs 0.95 

3e-02 

3e-03 

4e-04 

9e-03 

7e-04 

2e-03 

3e-02 

5e-02 


In each table we write down the mean and the median of the values of each 
estimator that we have obtained from the 100 replications, as well as some box-plot 
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Table 4: \(j>\ = 1.0164 and uncorrelated Gaussian innovation : C[tk] = A/”(0,1), m = 0, n = 400 


parameter 

0.8 

1.1 

1 

1.5 

1.1 

0.7 

1.0164 


estimate 

Ol 

a 2 

a 3 

a 4 

05 

06 

'<£ 


mean 

0.7999 

1.1000 

1.0000 

1.5000 

1.1000 

0.6999 

1.0163 

1.0163 

median 

0.8000 

1.0999 

1.0000 

1.4999 

1.0999 

0.7000 

1.0164 

1.0164 

error 

mean 

-8e-05 

4e-07 

4e-07 

5e-06 

2e-06 

-8e-06 

-7e-05 

-le-04 

sigma 

7e-04 

5e-05 

3e-06 

3e-04 

4e-05 

le-04 

7e-04 

9e-04 

boxplot 
u. whisker 

2e-04 

2e-05 

2e-08 

8e-05 

2e-05 

3e-05 

2e-04 

2e-04 

u. hinge 

5e-05 

3e-06 

5e-09 

2e-05 

2e-06 

2e-05 

5e-05 

5e-05 

1. hinge 

-4e-05 

-8e-06 

-6e-09 

-4e-05 

-4e-06 

-6e-06 

-4e-05 

-5e-05 

1. whisker 

-2e-04 

-2e-05 

-2e-08 

-7e-05 

-2e-05 

-3e-05 

-2e-04 

-2e-04 

percentile 
abs 0.95 

7e-04 

8e-05 

2e-06 

4e-04 

5e-05 

2e-04 

7e-04 

8e-04 


Table 5: \(j>\ = 1.0164 and correlated Gaussian innovation : C[ek\ = A7( 0 , 1 ), m = 2000, n = 400 


parameter 

0.8 

1.1 

1 

1.5 

1.1 

0.7 

1.0164 


estimate 

Ol 

02 

o 3 

a 4 

o 5 

ffl6 


0 

mean 

0.7999 

1.1000 

1.0000 

1.5000 

1.1000 

0.6999 

1.0163 

1.0163 

median 

0.7999 

1.1000 

1.0000 

1.5000 

1.1000 

0.6999 

1.0163 

1.0163 

error 

mean 

-8e-05 

9e-06 

-3e-10 

5e-05 

6e-06 

-2e-05 

-8e-05 

-8e-05 

sigma 

7e-04 

9e-05 

2e-09 

4e-04 

5e-05 

2e-04 

7e-04 

7e-04 

boxplot 
u. whisker 

2e-04 

3e-05 

5e-12 

2e-04 

2e-05 

5e-05 

2e-04 

2e-04 

u. hinge 

5e-05 

9e-06 

-2e-12 

4e-05 

6e-06 

2e-05 

5e-05 

5e-05 

1. hinge 

-7e-05 

-7e-06 

-2e-ll 

-3e-05 

-4e-06 

-2e-05 

-7e-05 

-7e-05 

1. whisker 

-2e-04 

-3e-05 

-4e-ll 

-2e-04 

-2e-05 

-5e-05 

-3e-04 

-3e-04 

percentile 
abs 0.95 

9e-04 

2e-04 

5e-10 

5e-04 

7e-05 

2e-04 

9e-04 

9e-04 


characteristics of the errors : extrem of upper whishers, upper hinge (3rd quarter), 
lower hinge (lrt quarter) and extrem of the lower whishers. We also give the 95% 
percentiles of the absolute values of the errors. 

First we not that the rates of convergence of the estimates decrease with \<j)\ (see 
Tables El [3j [4j [7] and [8]). Actually, from the theoretical point of view, the rate of 
convergence is \<f>\ n when \4>\ > 1 (Theorems 1 and 2 above). It is n when \(f>\ = 1 
(Boswijk and Franses 1995) and n 1 / 2 when \cj)\ < 1 (Basawa and Lund 2001). Thus 
we produce the histograms of scaled errors, the scale factor being when \<j)\ > 1, 
n -1 when cj) = 1 and n -1 / 2 when \(f>\ < 1. 

We observe when (f> = 1.4256 and when cj) = 1.0164 in Figures [D El El [U and [5j 
that the histograms of the scaled errors have long tails. In Tables El [3l 01 [5] and [6l 
we note that the ratios of the hinges (upper hinge, lower hinge) to the sigmas of the 
errors are of order of magnitude 10 _1 or less. It is the same for the ratios of the 
hinges to the whiskers. These phenomena correspond to the fact that the limiting 
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Table 6 : \(j>\ = 1.0164 and uncorrelated uniformly distributed innovation : C[t r \ = U[— 1000, 1000], 
m = 0, n — 400 


parameter 

0.8 

1.1 

1 

1.5 

1.1 

0.7 

1.0164 

estimate 

Ol 

a 2 

03 


05 

a 6 

4> 

0 

mean 

0.7991 

1.0998 

1.0000 

1.4996 

1.0999 

0.7000 

1.0156 

1.0150 

median 

0.7999 

1.1000 

1.0000 

1.5000 

1.1000 

0.7000 

1.0163 

1.0163 

error 









mean 

-9e-04 

-2e-04 

le-06 

-4e-04 

-2e-05 

2e-05 

-8e-04 

-2e-03 

sigma 

boxplot 

6e-03 

8e-04 

2e-05 

3e-03 

le-04 

2e-04 

6e-03 

le-02 

u. whisker 

2e-04 

3e-05 

4e-08 

2e-04 

2e-05 

4e-05 

2e-04 

2e-04 

u. hinge 

4e-05 

8e-06 

le-08 

4e-05 

5e-06 

9e-06 

4e-05 

4e-05 

1. hinge 

-8e-05 

-6e-06 

-4e-10 

-3e-05 

-4e-06 

-2e-05 

-8e-05 

-8e-05 

1. whisker 

-3e-04 

-3e-05 

-4e-05 

-2e-04 

-2e-05 

-4e-05 

-3e-04 

-3e-04 

percentile 
abs 0.95 

6e-04 

le-04 

7e-06 

4e-04 

6e-05 

2e-04 

6e-04 

7e-04 

Table 7: \<j>\ = 

1 and uncorrelated Gaussian innovation : C[t r 

= Af(0,l), m = 

0, n = 400 

parameter 

0.5 

1 

1 

2.5 

1.6 

0.5 

1 

estimate 

Ol 

a 2 

03 

04 

05 

as 

<t> 

0 

mean 

0.4948 

1.0000 

1.0000 

2.4372 

1.5972 

0.5004 

0.9944 

0.9644 

median 

0.4973 

1.0000 

1.0000 

2.4566 

1.5978 

0.5002 

0.9972 

0.9765 

error 









mean 

-5e-03 

-2e-06 

le-05 

-6e-02 

-2e-03 

4e-03 

-6e-03 

4e-02 

sigma 

9e-03 

2e-04 

4e-04 

6e-02 

3e-03 

6e-04 

9e-03 

4e-02 

boxplot 
u. whisker 

4e-03 

8e-05 

4e-04 

-8e-03 

-4e-04 

2e-03 

5e-03 

2e-03 

u. hinge 

-4e-04 

2e-05 

8e-05 

-3e-02 

-2e-03 

8e-04 

-5e-04 

-2e-02 

1. hinge 

-9e-03 

-2e-05 

-9e-05 

-8e-02 

-4e-03 

4e-05 

-le-02 

-5e-02 

1. whisker 

-2e-02 

-8e-05 

-4e-04 

-2e-01 

-7e-03 

-le-03 

-3e-02 

-le-01 

percentile 
abs 0.95 

3e-03 

5e-04 

9e-04 

3e-01 

8e-03 

2e-03 

3e-02 

2e-01 


distributions have heavy tails. See (Aknouche 2013) for independent innovation. 

When <f> = 1, in Figure [ 6 ] and in Table [7] we observe the distributions for some 
estimates (ay, 03 , a 6 , 4>) have also relatively long tails. But the phenomenon is very 
less apparent than previously. See (Phillips 1987) for the autoregressive model with 
a unit root. 

When cj) = 0.972, in Figure [7] the tails of the histograms are shorter than for the 
others values of q 1. In Table [ 8 ] the hinges and the whishers are often with the same 
order of magnitude or larger than the sigmas. This fits to the theoretical result, the 
limiting distribution being Gaussian (Basawa and Lund 2001). 

When the innovation {tt^} is correlated with m = 2000 for cf> = 1.0162, in Table[5] 
we observe few change in the performances of the estimates with respect to the case 
when the innovation is independent (Tabled]). The confidence intervals are smaller 
for 03 = 1, and larger for 04 = 1.5. However in Figure dl with (j) = 1-0164 and 
m = 2000, the tails of the histograms are farther from 0 than in Figure [3] when 
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Table 8: \4>\ = 0.972 and uncorrelated Gaussian innovation : C[e r \ = A/”(0,1), m = 0, n = 400 


parameter 

0.5 

1 

1.5 

1.62 

1.6 

0.5 

0.972 


estimate 

Ol 

a 2 

a 3 

a 4 

05 

06 

'<£ 


mean 

0.4938 

1.0000 

1.3983 

1.5579 

1.5765 

0.5071 

0.9662 

0.8612 

median 

0.4971 

1.0000 

1.4055 

1.5624 

1.5777 

0.5072 

0.9693 

0.8745 

error 

mean 

-7e-03 

5e-06 

-2e-01 

-7e-02 

-3e-02 

8e-03 

-6e-03 

-2e-01 

sigma 

2e-02 

5e-04 

3e-02 

2e-02 

4e-03 

le-03 

2e-02 

6e-02 

boxplot 
u. whisker 

2e-02 

5e-04 

-6e-02 

-4e-02 

-2e-02 

9e-03 

2e-02 

-3e-02 

u. hinge 

3e-03 

2e-04 

-9e-02 

-6e-02 

-3e-02 

8e-03 

4e-03 

-8e-02 

1. hinge 

-2e-02 

-2e-04 

-2e-01 

-8e-02 

-3e-02 

7e-03 

-2e-02 

-2e-01 

1. whisker 

-4e-02 

-5e-04 

-2e-01 

-le-01 

-4e-02 

7e-03 

-3e-02 

-2e-01 

percentile 
abs 0.95 

3e-02 

2e-03 

2e-01 

le-01 

4e-02 

9e-03 

3e-02 

2e-01 


m = 0 . 

Finally, comparing the statistics of the errors of the two estimates (j) and 4> in each 
table, we find out that they have globally the same order of magnitude whenever 
\cf>\ > 1 and the histograms are quite similar. However when \<f>\ < 1 it seems that 
4> gives better results than q i. The comparison of these two estimators need more 
investigation to determine whether one of them is better than the other. 


Conclusion 

In this paper we have studied the least squares estimators of the coefficients of explo¬ 
sive PAR(l) time series under relatively weak dependence assumptions. It is quite 
interesting to see how heavy tailed distributions enter in this context. We have also 
constructed two estimators of the product of these coefficients, which characterizes 
the explosive behaviour of the model. It would be worth to investigate the com¬ 
parison of these estimators and also to consider more general PAR and PARMA 
models. 


Appendix 

Proof of Proposition [lj 

Let r = 1,..., P be fixed. We know that 4>~ n X n p +r = A'[(X o + Z n _ i) + (j)~ n Un\ 
Since the sequence {Un is stationary with finite second order moments and |^| > 1, 
we can readily establish that 

lim = 0 a.e and in q.m.. 

n—>oo 

Now we show that Z n converges almost surely and in quadratique mean. First we 
have 
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Figure 1: Histograms of the scaled errors : 0 = 1.4256, C[e r \ = A/*(0,1), m = 0, n = 20 


var 


E •r'-'vP 

1=3 

= gr 2 - 2 

r 2 ^ p) 

- 6 2 - 1 


var 


+ 2 - 


U, 


( p) 


k-i 


+ 2 E E r h ~ l2 ~ 2 

h=j h=h+l 

“ M -i) 2 ' 


cov 


uip.uip 


( 6 ) 


Then the sequence { Z n } is a Cauchy sequence in the Hilbert space L 2 (P), thus this 
sequence converges to some random variable Q in quadratic mean. Moreover 


E 


(Z n 



0 - 2 n id p) 
“ (M-i) 2 ' 


From the exponential decreasing to 0 of the right hand side of the last inequality, we 
can readily deduce the convergence almost sure following the usual method applying 
Borel Cantelli lemma. 

As for the second part of the proposition, note that 


X nP+r ~ r A[ (X 0 + C) = £#> + (j) n A\ (Z n _! - 0 
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Figure 2: Histograms of the scaled errors : cj) — 1-0164, C[e r \ = A/”(0,1), m = 0, n = 200 


and 


<z„-i - o = - £ r-‘-'ui p> -- Lr'-'gS- 

l=n 1=0 


Since the sequence of random vectors {({7*,..., U^) : n € Z} is stationarily dis¬ 
tributed, we deduce that 


C 


K 1=0 J 


= C 


:r = l 

1=0 


Then from the definition of (, we readily achieve the proof of Proposition [T] . □ 


Proof of Theorem [T| 


(r) 

First in the two following lemmas we study the asymptotic behaviours of B n ' and 
Mr) 


Lemma 1 


— 1 \ 2 


(A r ~~ 1 ) 

lint <fr 2n B^ = —— (A'o + C) 2 a.s. and in L 1 (P). 

ar — 1 


Proof We have seen that that </> n X n p +r _i converges to A\ 1 (Xo + C) almost surely 
and in quadratic mean. Then Toeplitz lemma on series convergence gives the result. 
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Figure 3: Histograms of the scaled errors : cf> = 1.0164, £[e r ] = Af( 0,1), m = 0, n = 


□ 


Lemma 2 


lim i j) 2n C^ ] = 0 a.s. and in L 1 (P) 

n —>oo 

for any r = 1, ... ,P. Moreover, under the mixing hypothesis (M) we have 
r n Cl r) :r = l,...,p] =£[A r 1 - 1 (X 0 + ()C r :r = l,...,P] 


lim C 

n—>oo 


Proof To prove the lemma we study the left hand side of equality (pTj) . 

1) For the last term of equality ((4]), Cauchy Schwarz inequality entails 


E 



n —1 


n —1 


2' 

!/ 2 



E c, f~ 1 V+'- 


<E E 

u^> 


E 

1 I 2 

| 'U'jP+r \ 


3=0 


3=0 L 






11/2 


As the sequences {ujp +r } and {Uj 1 are stationary, we have 


E 


n —1 

E TT-C-i) 

Uj UjP+r 

3=0 


= n\/ Kq t v . 
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Figure 4: Histograms of the scaled errors : <j) — 1-0164, C[e r \ = A/"(0,1), m = 2000, n = 400 


Thus 

n —1 

lim (f>~ n u[ r ^Ujp-i- r = 0 in L 1 (P). 

71 — XX ) J J J 

3=0 

Furthermore, thanks to the exponential decreasing rate of convergence to 0 in L 1 (P), 
applying Borel Cantelli lemma, we easily establish the almost sure convergence 


71 — 1 

lim (fT n u\ r ^Ujp+r = 0 a.s. 

n —>oo zJ 

3 =0 

2) To study the first term of left hand side of equality JU the idea is first to isolate 
the sums of Zj_\ and of Ujp+ r . Then define blocks that separate the first and the last 
terms of the time series in order to be able to use the asymptotic independence which 
is given by the strong mixing condition on the innovation. Thus assume without lost 
of generality that n is a multiple of 4 and let n\ = n/4, and ri 2 = n/2. Then we can 
write 


71 — 1 71—1 

^ ^ 4 ^ (-^0 “ 1 “ Zj—\)Ujp+ r — ^ ^ 4^ 1 Zm)VjjP-\-r 

3=0 3=0 

712 — 1 71—1 

+ yy p ( x 0 + z ni ) UjP+r + y $( Xq + z ni ) ujp + r . (7) 

3=0 j=n 2 
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Figure 5: Histograms of the scaled errors : <j> = 1.0164, C[t T \ = IA[— 1000, 1000], m = 0, n = 400 


(i) Thanks to inequality ([6]) we have 


E 


n —1 


^ ^ th (Zj — | Z ni )ujp +r 


n—1 


211/2 


< \WV[\Zj-1 - Z ni \Y 2 E[\u jP+r \ 2 ] 

3=0 J j =0 

ni n—1 

< J^\</>\ j E[\Z j . 1 -Z ni \ 2 ] 1/2 <r r + ^ 1 / 2 <r r 

i=o j=m+i 

< "1 + 1 + W"-"‘ ,/T^y 


101-1 


Hence 


n—1 


lim i j) 71 (fPiZj-i — Z ni )ujp +r = 0 in L 1 (P). 

n—»■ oo ^ ^ J 


3=0 

Using Borel Cantelli lemma, the exponential decreasing rate of convergence permits 
to prove the almost sure convergence. 
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Figure 6: Histograms of the scaled errors : <f> = 1 , £[e r ] = A/”(0,1 ), m = 0, n = 400 

(ii) Besides, the second term of the right hand side of equality (0 can be estimated 
as follows 


E 


n 2 —1 

(*o + Z ni )Y, (fP Ujp+ r 

3=0 


< E [| A' 0 + Z ni | 2 ] 1/2 \^E[\u jP+r \ 2 ] 


U2—1 


211/2 


< 


< 


77.1 — 1 

E[|X 0 | 2 ] 1/2 + ^ \<f>\~ l ~ 1 E[\Ui P ' > \ 2 ] 1/2 

3=0 

(e[|A' 0 | 2 ] 1 /2 (|0| - 1) + ^K^)a r \ct>r 

M 


3=0 

' 712 —1 


E \WV[(u jP+r ) 

3=0 


21 1/2 


Thus 


712 — 1 


lim <f> n (X 0 + Z ni ) (fPu,jp +r = 0 in L 1 (P). 

n—too 

3=0 

As in part (i), we obtain the almost sure convergence. 

(iii) It remains to study the asymptotic behaviour of (Xq + Z ni )^n’ 2 r where 


77—1 


77—1 


77—772 


* n n r 2 ■■= r n 


y ^ 4^ u jp+r — y ^ 4^ Ujp+ r — y ^ </> j u^ n _j^pj rr . 

3 =1 


3= n 2 


3=^2 


( 8 ) 
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Figure 7: Histograms of the scaled errors : <j> = 0.972, C[e r \ = A/”(0, 1), m = 0, n = 400 


We know that Xo + Z ni converges to Xq + ( almost surely and in quadratic mean. 
(Proposition [H). Since 


E[|«f| 2 ] 1/2 < 


n —722 


^ ] 1^*1 ^^\\ u (n—j)P+i 

3 = 1 


, 211/2 


< 


(J j- 


4> n ^n 2 converges to 0 in quadratic mean and also almost surely. Hence 0 u (Xq + 
Z ni )*Z converges to 0 in F X (P) and almost surely. 


(iv) Now we establish the convergence in distribution of (Xo + Z ni )''ff% 2 . Note that 
(Xo + Z ni ) can be expressed with Xo, U\,U 2 , ■ ■ ■, U( ni +i)P while \F^ r can be expressed 
with u n2 p ,... ,u n p. Hence, as ri\ = 712/2 = n/ 4, the mixing property entails that 


P[X 0 + Z n 


for all Borel subsets A and B of R, where a(-) is the strong mixing coefficient. The 
mixing hypothesis entails that a((n/4 — 1)P)) tends to 0 as n goes to oo, thus 


f lhn (p [Xo + Z ni € A, ^ € B\ - P [Xo + Z ni € A] X P € B] ) = 0. 

for all Borel subsets A and B. So Xq + Z ni and are asymptotically independent. 
We know that Xo + Z ni converges in quadratic mean so in distribution to Xo + C 
(Proposition [1]). Now it remains to study the behaviour of 'F^- 
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(v) Since the time series {uk} is periodically distributed, the time series {u^} is also 
periodically distributed. Denoting 

n 

*; w := 

3 = 1 

we have Tf’XEj = ], and the sequence {\Fn^} converges almost surely and 

in quadratic mean to some random variable (*. Then \F^ r converge in distribution to 
C* as n — 112 = n/2 —>• oo. Consequently (Xo + X n] converges in distribution to 
(X 0 + C)C* (r) where Xo + C and are independent random variables. Furthermore 
from definition ©, we easily deduce the distribution of the £*s. 

Following the same lines with Cramer device we can establish the multidimen¬ 
sional convergence. □ 


Proof of Theorem [I] The almost sure convergence is a direct consequence of Lem¬ 
mas [Tj and [21 To prove the convergence in distribution, we first apply Cramer device 
to prove the convergence in distribution of ( (f>~ 2n Bn \ ..., <f>~ 2n Bn P , (j)~ n Cn\ ..., < 
For this purpose, let aq,..., ap, {3 \,..., /3p Gl and establish the convergence in dis¬ 
tribution of 

p p 

r =1 r =1 

Following the same method as in the proof of Lemma [2] we define blocks to separate 

(r) (V) 

the terms Bn ; and Cn , as well as to apply the asymptotic independence given by 
the strong mixing condition. Denote n\ = nil2 = n/4. Then S n can be decomposed 
as 

p p p 

s n = J2 a r{r 2n B^ - r 2ni s £>)+ r 2ni E ^ + r n E 

r =1 r= 1 r =1 

Thanks to Lemma [U <f>~ 2n B^ —4>~ 2ni Bn} converges to 0 almost surely. Moreover 
thanks to the parts 1, 2(i) and 2(ii) of the proof of Lemma El it remains to study 

n n 

E «r -r^B^ + E Pr(X 0 + z ni )*%. 

r =1 r=1 

Then from the strong mixing condition, (Bn },..., Zn \} is asymptotically 

independent with respect to (’F^ 1 , ■ ■ ■, ^n’ P ), and following the same lines as in the 
part 2(v) of the proof of Lemma [2] we deduce the convergence in distribution of S n 
as n —>• oo. 

Finally the application of the continuous mapping theorem for convergence in 
distribution completes the proof of the theorem. □ 
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Proof of Theorem [2| 

Theorem [2] is a direct consequence of the following lemma about the asymptotic 
behaviours of B n and C n . 

Lemma 3 

lim (j)~ 2n B n = {A~+ 1 ) 2 < P' a.s. and in L 1 (P); (9) 

n—> oo ^ J v ' 7 (7)" — 1 

r=l r 

lim (f>~ 2n C n = 0 a.s. and in L 1 (P); 

n—>-oo 

and 

lim C[r n C n ] =C[(X 0 + £)(*]. (10) 

n .—^nn l j l j 


Proof 1) First note that B n can be expressed as follows 

B n = J 2 ^ 1 1 + B^-(X o) 2 . 

r =2 

Then thanks to Lemma [I] 

lim (jr 2n B n = (l+cf)^ 2 'S^ (A, -1 ) 2 ^ ^ ,9 ^ a.s. and in L 1 (P). 

n—Hy o \ ' z ' v ' / <p z — 1 

Using the fact that = (Af) 1 , we deduce limit l]9|). 

2) The convergence almost sure and in L 1 (P) of (j)~ 2n C n to 0, can be easily 
obtained following the lines of the proof of the convergence almost sure and in T 1 (P) 
of (f)~ 2n Cn^ in Lemma [21 Thus the proof is left to the reader. 

3) From its definition, C n can be expressed by 

P n —2 P n —2 

e-. = E^E^’ + E E U’y+i- t 11 ) 

r=l j= 0 r=l j=0 


(i) Thanks to the stationarity of the sequences { {U ^\..., : j G Z} and 

{ (vf\ ..., Vj P : j G Z}, the second term of expression dill) is of order of magni¬ 
tude n in probability. Indeed 


E 


P n—2 

EEk 

r=l j =0 


(r)y{r) 

V j +1 


<(»-i)E E K’) : 


r=l 


1 1 / 2 . 


E 


ttf 0 ) 


1 1/2 
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(ii) Following the same lines as in the proof of Lemma [21 and using the stationarity 
of {(V^,..., Vp) : j £ Zj we can readily prove that 

P n—2 

= ( x ° +z m)n 2 +op(i) 

r=l j= 0 

where ni = = n/4 and 

P n—2 P n—n ,2 

'K, ■= E - 4 'i E = E A i E r j v£?, + i. (12) 

r=l j=n 2 r= 1 j= 2 

The mixing hypothesis (M) entails that Xq + Z ni and are asymptotically inde¬ 
pendent. Besides the distribution of 

P P—1 n— ri 2 

n = EE A\A r r _ k+1 ^2 & ^ U (n-j+l)P+r-k■ 

r= 1 k= 0 j= 2 

coincides with the distribution of ’F*_ n2 where 

p P-l n 

*; := E E A w~k+i E 

r=l k= 0 J=2 

and the sequence {u k } is dehned in part 2(v) of the proof of Lemma [21 The se¬ 
quence {«£} i s independent with respect to Xq and {uk}, thus the sequence {^n} is 
also independent with respect to Xq and {uk}- Since the sequence { u £} is centered 
periodically distributed with second order moments, the sequence {T*} converges 
almost surely and in quadratic mean to some random variable (*. Thanks to the 
definition (fT2l) of Hi™ and the periodicity of the distribution of the innovation {«&}, 
we deduce the distribution of £*. Then limit Col) is proved. □ 
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